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Abstract. Turing’s famous ‘machine’ model constitutes the first intu- 
itively convincing framework for computing with real numbers. Kleene’s 
computation schemes S1-S9 extend Turing’s approach to computing with 
objects of any finite type. Both frameworks have their pros and cons and 
it is a natural question if there is an approach that marries the best 
of both the Turing and Kleene worlds. In answer to this question, we 
propose a considerable extension of the scope of Turing’s approach. Cen- 
tral is a fragment of the Axiom of Choice involving continuous choice 
functions, going back to Kreisel-Troelstra and intuitionistic analysis. Put 
another way, we formulate a relation ‘is computationally stronger than’ 
involving third-order objects that overcomes (many of) the pitfalls of 
the Turing and Kleene frameworks. 


Keywords: Computability theory, Kleene 51-59, Turing machines 


1 Between Turing and Kleene computability 


1.1 Short summary 


In a nutshell, we propose a sizable extension of the scope of Turing’s ‘machine’ 
model of computation ([50]), motivated by a fragment of the Axiom of Choice 
involving continuous choice functions, going back to Kreisel-Troelstra and in- 
tuitionistic analysis ([22]). In particular, we formulate a relation ‘is computa- 
tionally stronger than’ involving third-order objects but still based on Turing 
computability by and large. 


The interested reader will find the aforementioned extension discussed in 
more detail in Section [I.2] along with a critical discussion of the scope of our 
extension. The critical reader will learn about the pressing need for the aforemen- 
tioned extension in Section [1.3] In particular, the latter section seeks to alleviate 
worries that existing frameworks are somehow sufficient for our (foundational) 
needs. The (problems involving the) representation of third-order objects via 
second-order ones is a particularly important ‘case in point’. 


Next, some elegant results in our proposed extension are listed in Section [2] 
pertaining to the following topics: 


— convergence theorems for nets in the unit interval (Section 2.1.2), 
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— covering theorems for the unit interval R (Section [2.1.3), 
— the uncountability of the real numbers R (Section 2.2), 
— discontinuous functions on the real numbers R (Section [2.3). 


We note that all our results are part of classical mathematics, while we have 
found constructive mathematics highly inspiring on our journey towards this 
paper. We will assume familiarity with Turing-style computability theory ([44]) 
and higher-order primitive recursion like in Gédel’s system T ((24] p. 74]); knowl- 
edge of Kleene’s higher-order computability theory, in particular the computa- 
tion schemes $1-S9 (see [18}[24]), is useful but not essential. 


Finally, we will discuss a number of theorems of real analysis and the following 
remark discusses how the representations of real numbers can be done in a 
straightforward and non-intrusive way. 


Remark 1 (Representation of real numbers) Kohlenbach’s ‘hat function’ 
from p. 289] guarantees that every element of N defines a real number 
via the well-known representation of reals as fast-converging Cauchy sequences. 
Despite the definition of the latter being H}, a quantifier ‘(Vz € R}? amounts to 
a quantifier over NN. 


Moreover, Kohlenbach’s ‘tilde’ function from Def. 4.24] guarantees that 
‘(Vx € [0,1])’ also just amounts to a quantifier over NN, despite 0 <p £ <p 1 
being J? (in addition). These functions ensure a smooth treatment of R, [0,1], 
and 2N and functions between such spaces. We will always assume that real 
numbers and R — R-functions are given in this way, i.e. as in the aforementioned 
references [20\[21], so as to ensure a smooth treatment. 


1.2 Extending the scope of Turing computability 


In this section, we discuss the extension of Turing computability mentioned in 
Section In particular, we introduce this new concept in Section and 
discuss its scope in Section [1.2.2] The reader will have a basic understanding 
of Turing computability theory ({44]) and higher-order primitive recursion like 
Gédel’s system T (P4 p. 74]). 


1.2.1 A new notion of reduction In this section, we formulate (4), which is 
a relation formalising ‘is computationally stronger than’ involving third-order 
objects but still based on Turing computability. We first need some preliminaries, 
starting with (i). 


First of all, many theorems in e.g. analysis can be given the form 


(VY : NN > N)\(ar € W)A(Y, x), (1) 


where NN is the Baire space and N is the set of natural numbers. Indeed, as 
discussed in Remark [I] some basic primitive recursive operations relegate the 
coding of real numbers (via elements of NN) to the background. Moreover, a list 
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of theorems that can be brought in the form can be found in Example 
below, while we discuss the scope of theorems that can be brought in this form 
at the end of this section and in Section [1.2.2 


Secondly, to improve readability, one often uses type theoretic notation in 
(I), i.e. n° for type 0 objects n € N, x! for type 1 objects x € NN, and Y? 
for type 2 objects Y : NN + N. We will only occasionally need type 3 objects, 
which map type 2 objects to natural numbers. We generally use Greek capitals 
63, A®,... for such objects. 


Thirdly, to compare the logical strength of theorems of the form (I), one 
establishes results of the following form over weak systems: 


(VY?) (Ax!) A(Y, x) > (VZ?) (Sy) B(Z, £), (2) 


as part of Kohlenbach’s higher-order Reverse Mathematics (see for an in- 
troduction). The computational properties of and following S1-S9 can 
then be studied as follows: let ©? and A® be realisers for the antecedent and 
consequent of (2) i.e. (VY?)A(Y,O(Y)) and (VZ?)B(Z, A(Z)). 


A central computability theoretic question concerning (2) is whether a re- 
aliser O? for the antecedent of (2) computes, in the sense of S1-S9, a realiser 43 
for the consequent of (2), i.e. whether there is a Kleene algorithm with index 
e € N satisfying the following: 


(vo") [(VY")A(Y, O(Y)) > (WZ?) B(Z, {e}(9, Z))]. (3) 


Next, we list some theorems that have been studied via the above paradigm 
based on (3) and $1-S9. 


Example 2 (Some representative theorems) 


— The Lindelöf, Heine-Borel, and Vitali covering theorems involving uncount- 
able coverings ([29][301[34)), 

— The Lebesgue number lemma ([331[34]), 

— The Baire category theorem ([33]), 

— Convergence theorems for nets ([39}/40)[42]), 

— Local-global principles like Pincherle’s theorem ([34]), 

— The uncountability of R and the Bolzano- Weierstrass theorem for countable 
sets in Cantor space ([351[37]), 

— Weak fragments of the Axiom of (countable) Choice ([36]). 

— Basic properties of functions of bounded variation, like the Jordan decom- 
position theorem ([88]). 


Many more theorems are equivalent -in the sense of higher-order RM as in [20]- 
to the theorems in the above list, as can be found in the associated references. 


Fourth, for all the reasons discussed in Section [1.3| we formulate a version of 
based on Turing computability as follows: 


(VZ?, a") [A(e(Z), 2) > [{e}*F” LA B(Z, e, (4) 
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where s?~!, t?>? are terms of Gédel’s T and ‘{e}*’ is the e-th Turing machine 
with oracle X C N. We note that readily] implies (3); we discuss the gener- 
ality of (4) at the end of this section. 


In line with the nomenclature of computability theory, we call the antecedent 
and consequent of ‘problems’ and say that 


solving the problem (VZ?)(Ay')B(Z, x) N-reduces to solving the problem 
(VY?) (aa*)A(Y, x) 


in case (4) holds for the parameters mentioned. We view the N-reduction relation 
as ‘neutral’ between the Turing and Kleene framework and the reader readily 
verifies that N-reduction is transitive. In case the term s(Z,x) can be replaced 
by a term u(x), i.e. the latter has no access to Z, we refer to as strong 
N-reduction. 


Finally, the critical reader may wonder about the generality of (4). The latter 
is quite general, for the following two reasons. 


— It is an empirical observation based on [29H38] that positive results in S1- 
S9 computability theory can be witnessed by terms of Gédel’s T of low 
complexity. In this light, there is no real loss of generality if we use terms of 
Gédel’s T as in (4). 

— A theorem of (third-order) ordinary mathematics generally has the form 
(1), unless the former implies the existence of a discontinuous function on 
R. In the latter case, an ‘indirect’ treatment is still possible via the so-called 
Grilliot’s trick, which we sketch in Section 2.3.1] 


Like the reader, we feel that the second item deserves a more detailed expla- 
nation, which is in Section [1.2.2] Regarding the first item, intellectual honesty 
compels us to admit that many of our S1-S9 results are witnessed by terms of 
Gédel’s T additionally involving Feferman’s search operator (already found in 
Hilbert-Bernays [16]) defined for any f! as: 


io i least n° such that f(n) =O (m)(f(m) = 0) (5) 


0 otherwise 
While not strictly necessary always, it is convenient to have access to u? as we 


then do not have to worry how spaces like [0, 1] or 2% are represented. Based on 
this observation, we introduce the following: 


solving the problem (VZ?)(Ay')B(Z, x) wN-reduces to solving the problem 
(VY?) (Ax*) A(Y, x) 


in case holds for the parameters mentioned except that t(Z) is replaced by 
t(Z, u°). Then ‘strong’ zN-reduction is defined similarly. 


Finally, one could study for other extensions of Gédel’s T, e.g. involving 
‘minimization’ (see §5.1.5]), but (4) seems more salient. 


1 For e € N and s?7!, t??? as in (4), define eo € N as the Kleene algorithm such that 
{eo}(O, Z) := {e}*\4°U)) | which is total by assumption. 
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1.2.2 Continuous and discontinuous functionals We discuss the motiva- 
tion behind our notion of N-reduction and establish its scope. To this end, we 
have to make the following classical case distinction. 


— If a given third-order theorem is consistent with Brouwer’s continuity the- 
orem that all functions on R are continuous ([8]), then we can directly 
analyse it via N-reduction. 

— If a given third-order theorem implies the existence of a discontinuous func- 
tion on R, we can indirectly analyse it via N-reduction based on Grilliot’s 
trick, where the latter is sketched in Section 


To make sense of the above, we first sketch the ‘standard’ higher-order gener- 
alisation of (second-order) comprehension, exemplified by Kleene’s 3? as in (6). 
We then discuss another (less famous) formulation of comprehension, called the 
neighbourhood function principle as in Definition [4] a fragment of the Axiom of 
Choice involving continuous choice functions, going back to intuitionistic anal- 


ysis (R247). 


First of all, the commonplace one cannot fit a round peg in a square hole has 
an obvious counterpart in computability theory: a type 2 functional cannot be 
the oracle of a Turing machine. Nonetheless, a continuous type 2 functional can 
be represented by a type 1 Kleene associate as in Definition [B] where we employ 
the samd] notations as in [19]. Associates do ‘fit’ as oracles of Turing machines. 


Definition 3 (Kleene associate from [19]) 


— A function at is a neighbourhood function if 


® (V3*)(An°)(a(Bn) > 0) and 
e (Vo® 7° \(a(o) > 0 + a(o * T) =a(a)). 
— A function a? is a (Kleene) associate for Y? if 
© (¥81)(2n®)(a(Bn) > 0) and E 
e (V81, n?)(n is least s.t. a(Bn) > 0 > a(Bn) =Y (8) +1). 


As in §4], we additionally assume that an associate is a neighbourhood func- 
tion, as the former can readily be converted to the latter. 


Hence, we should specify that a discontinuous type two functional cannot be 
the oracle of a Turing machine. Now, the archetypal example of a discontinuous 
function is Kleene’s quantifier 3? defined as: 


VDL EADEM = 0) eP) = 0). (6) 


Clearly, (6) is the higher-order version of arithmetical comprehension (see e.g. 
II]) stating that {n € N : A(n)} exists for arithmetical formulas A, which 
includes the underlined formula in (6). We point out Grilliot’s trick, a method 


? In particular, o° is a finite sequence in N with length |a| and we assume the well- 
known coding of such finite sequences by natural numbers. Moreover, fn is the finite 


sequence (f(0),...,f(n—1)) for any ft and n°, and any f°” in case |f| < n. 
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for (effectively) obtaining 3? from discontinuous functionals on e.g. R or 2N, as 
also discussed in Section |2.3.1} To our own surprise, this kind of effective result 
is essentially the prototype of (4), as discussed in Section [2.3.2 


2 


Now, as noted above, Kleene’s 4° can decide the truth of arithmetical for- 
mulas. In general, for a formula class I’, one can study higher-order functionals 
that decide the truth of formulas y € I’. Examples are Kleene’s quantifiers 4” 
((24] Def. 5.4.3]) and the Feferman-Sieg functionals vn from [9] p. 129], which 
we shall however not need. 


Secondly, we consider the neighbourhood function principle NFP from |48}, 
studied in under a different name. 


Definition 4 [NFP] For any formula A(n°), we have 
(Vf?)(an°) A(frn) > (Ay € Ko) YAFA), (7) 


where ‘y € Ko’ means that 7! is a (total) Kleene associate. 


Clearly, is a fragment of the Axiom of Choice involving continuous choice 
functions. Not as obvious is that NFP is a ‘more constructive’ formulation of the 
comprehension axiom (see Remark [5] below). We also note that NFP involving 
third-order parameters has the form (I), namely for a formula A(n}, Y?) with 
all parameters shown, (Z) yields 


(V¥*)(Ay*) (VF) Gn An, Y) > [ye KoA (WF YAFYA)I. (8) 
Now, NFP proves the Lindelöf lemma ([48]), inspiring Theorem [12] 


Finally, we can combine the above as follows: the case distinction from the 
beginning of this section distinguishes between whether a given theorem Ẹ in 
the language of third-order arithmetic implies the existence of a discontinuous 
function (on R or 24), or not. It is then an empirical observation based on 
that for this theorem F, either the theorem T implies the existence of 3? via the 
aforementioned Grilliot’s trick, or { is provable from a fragment of NFP where 
A may include third-order parameters. 


In the former case, the theorem Ẹ can be analysed ‘indirectly’ using N- 
reduction, namely via Grilliot’s trick, as discussed in Section[2.3] In case the the- 
orem & is provable from a fragment NFP (with third-order parameters), we can 
generally bring T in the form and hence analyse it directly via N-reduction. 
In light of (8), fragments of NFP can always be analysed via N-reduction. 


In conclusion, second-order comprehension has been generalised to higher 
types in two (more-or-less-known ways) ways, namely as follows. 


— Formulate ‘characteristic functionals’ like 3? from (6) that decide the truth 
of certain formulas. 

— Formulate NFP as in Definition [4] for formulas involving higher-order param- 
eters and variables. 
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If a given theorem implies the existence of 3?, we can analyse it ‘indirectly’ via 
N-reduction, namely via Grilliot’s trick. If a given theorem is provable from NFP 
involving third-order fragments, we can (readily) analyse it via N-reduction. In 
other words, if a third-order theorem is consistent with Brouwer’s continuity 
theorem that all functions on R are continuous ([8]), then we can analyse it 
directly via N-reduction. 


Finally, we show that NFP classically follows from comprehension and vice 
versa, assuming a fragment of the induction axiom. 


Remark 5 (NFP and comprehension) To obtain NFP from comprehension 
modulo coding of finite sequences, let X be such that o € X © A(o°’) for 
any finite sequence o°% in N. Then define y(c) := |o| +1 in case ø € X, and 0 
otherwise. Assuming the antecedent of (7), this yields a (total) Kleene associate. 
By definition, y also satisfies the consequent of (7). 


To obtain comprehension from NFP, suppose towards a contradiction that 
comprehension is false, i.e. there is some formula A(n) such that 


(VX CN)(an € N)|[n € X A7A(n)] v [A(n) An ¢ X]]. (9) 


Now apply NFP to (9) (coding X C N as elements of 2‘) to obtain y € Ko. The 
latter has an upper bound ko € N on 2N, i.e. n € N in (Q) is bounded by ko. 
However, the induction axiom readily proves ‘finite comprehension’ as follows: 


(vk € N)(AX CN)(Vn < k)[n € X & A(n)]. (10) 


Hence, for k = ko + 1, (10) yields a contradiction. 


1.3 The need for an extension of Turing computation 


We argue why the extension of Turing computation sketched in Section [1.2] is 
necessary and even most welcome, as follows. 


— Higher-order objects are ‘coded’ as reals so as to accommodate their study 
via Turing machines. It has recently been established that this ‘coding prac- 
tise’ yields very different results compared to Kleene’s approach, even for 
basic objects like functions of bounded variation (Section [L.3.1) 

— The conceptual complexity of Kleene’s extension of Turing computability is 
considerable, while the extension to ‘infinite time’ Turing machines is too 
general for our purposes (Section [I.3.2). 


Put another way, N-reduction is an attempt at formulating a relation ‘is com- 
putationally stronger than’ for third-order statements that overcomes the above 
pitfalls, namely the conceptual complexity of Kleene’s S1-S9 and the problems 
associated with second-order representations. 
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1.3.1 Computing with second-order representations We show that there 
are huge differences between ‘computing with higher-order objects’ and ‘com- 
puting with representations of higher-order objects’, even for basic objects like 
functions of bounded variation on [0, 1]. 


Now, varioud}] research programs have been proposed in which higher-order 
objects are represented/coded as real numbers or similar representations, so as 
to make them amenable to the Turing framework. It is then a natural question 
whether there is any significant differenced between the Kleene S1-S9 approach 
or the Turing-approach-via-codes. 


Continuous functions being well-studied4l in this context, Dag Normann and 
the author have investigated functions of bounded variation, which have at most 
countably many points of discontinuity ([38]). A central result is the Jordan 
decomposition theorem which implies that f : [0,1] —> R of bounded variation 
on [0,1] satisfies f = g — h on [0,1] for monotone g,h : [0,1] > R. We have the 
following results. 


— In case f : [0,1] — R of bounded variation is given via a second-order 
representation, then the monotone g, h : [0,1] + R such that f = g — h, can 
be computed from finite iterations of the Turing jump with f as a parameter 
by Cor. 10]. 

— A Jordan realiser J takes as input f : [0,1] > R of bounded variation and 
outputs J(f) = (g,h), i.e. monotone g,h : [0,1] > R with f = g — h on 
[0,1]. No Jordan realiser is computable (S1-S9) in any type 2 functional by 
37, Theorem 3.9]. 


Regarding the second item, a Jordan realiser is therefore not computable from 
(finite iterations of) 3°, the higher-order counterpart of the Turing jump. The 
same holds for Sz, which is a type two functional that can decide IT j-formulas 
(involving first- and second-order parameters). The usual proof of the Jordan 
decomposition theorem implies that Kleene’s 3° computes a Jordan realiser. But 
38 implies full second-order arithmetic, and the same holds for the combination 
of all Sz. 


In conclusion, there is a huge difference in the computational hardness of the 
Jordan decomposition theorem depending on whether we use representations or 
not. However, this theorem deals with functions of bounded variation, a class 
‘very close’ to the class of continuous functions. Hence, (Turing) computing with 


3 Examples of such frameworks are: reverse mathematics ([43||46]), constructive analy- 

sis ({3] 1.13], [5]), predicative analysis ([I3]), and computable analysis ([52]). Bishop’s 
constructive analysis is not based on Turing computability directly, but one of its 
‘intended models’ is (constructive) recursive mathematics, as discussed in [7]. One 
aim of Feferman’s predicative analysis is to capture Bishop’s approach. 
The fan functional constitutes an early natural example of this difference: it has a 
computable code but is not S1-S9 computable (but S1-S9 computable in Kleene’s 3? 
from Section |1.2.2). The fan functional computes a modulus of uniform continuity 
for continuous functions on Cantor space; details may be found in [24]. 
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representations, interesting as it may be, is completely different from (Kleene) 
computing with actual higher-order objects. In this light, there is a clear need 
for a notion like N-reduction that allows us to compute with actual higher-order 
objects while staying close to Turing computability. 


1.3.2 On higher-order computation We argue that the conceptual com- 
plexity of Kleene’s $1-S9 is considerable, while the extension to ‘infinite time’ 
Turing machines is too general for our purposes (Section [L.3.2). 


First of all, as noted above, Turing’s famous ‘machine’ model constitutes 
the first intuitively convincing framework for computing with real numbers ([50]) 
while Kleene’s $1-S9 extend Turing’s approach to computing with objects of any 


finite type (M324). 


We have studied or made extensive use of Kleene’s $1-S9 computability the- 
ory in . In our opinion, while vastly more general in scope, Kleene’s S1-S9 
has the following conceptual drawbacks. 


— Turing computability boasts the elementary ‘Kleene T-predicate’ (see e.g. 
[44] p. 15]) where T(e, x,y) intuitively expresses that y codes the compu- 
tation steps of the e-th Turing machine program with input x. There is no 
such construct for $1-S9. 

— Kleene’s recursion theorem is one of the most elegant and important results 
in Turing computability (44| p. 36]) and is derived from first principles. By 
contrast, Kleene’s schemes $1-S8 formalise higher-order primitive recursion 
(only), while S9 essentially hard-codes the recursion theorem for $1-S9. 

— Natural space and time constraints can be formulated for Turing machines, 
yielding a canonical complexity theory ([I]); to the best of knowledge, no 
such canonical theory exists for higher-order computation in general or S1- 
S9 in particular. 

— Even basic questions concerning $1-S9 computability theory can be chal- 
lenging. We have formulated a most basic example in Section[2.2]concerning 
the uncountability of R, arguably one of the most basic properties of the 
real numbers, which nonetheless yields very hard problems regarding S1-S9 
computability. 


In conclusion, the previous items suggest that the much greater scope of $1-S9 
comes at the cost of conceptual clarity and causes technical difficulties. It is then 
a natural question whether we can find a ‘sweet spot’ between the conceptual 
clarity of Turing computability on one hand, and the generality of S1-S9, leading 
us to N-reduction. 


Secondly, an infinite time Turing machine (ITTM) ([15]) is a generalisa- 
tion of Turing computability involving infinite time or space. Welsh provides an 
overview in and Dag Normann studies non-montone inductive definitions 
and the connection to ITTMs in [28]. 


In particular, Normann shows that ITTMs can outright compute many of the 
functionals introduced in [29\[31/[34), including realisers for the covering lemmas 
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due to Vitali, Heine-Borel, and Lindelöf. However, all these functionals are not 
51-S9 computable in any type two functional, i.e. the former are ‘hard to com- 
pute’ (see [29|[31/34]). As a result, ITTMs yield ‘too strong’ a baseline framework 
for our purposes. 


2 Some results 


We establish some results based on our freshly minted notion of N-reduction 
from Section [1.2| namely concerning the following topics. 


— Convergence theorems for nets (Sections [2.1.2] and 2.1.3). 

— Covering theorems (Sections [2.1.3). 

— The uncountability of R (Section 2.2). 

— Discontinuous functions on R and Grilliot’s trick (Section 2.3). 


The below just constitutes an illustrative first collection of examples: we do not 
claim our results to be particularly deep or ground-breaking. We do point out 
that the above items yield functionals that are, like the Jordan realisers from 
Section [1.3.1] hard to compute in that no type 2 functional can (S1-S9) compute 
them, while 3? can. 


Finally, the curious reader of course wonders what the counterpart of the 
Turing jump is for N-reduction. We believe this to be the ‘J’ operation discussed 
in Section [2.1.2 


2.1 Nets and computability theory 


We study basic properties of nets via N-reduction. Nets are a generalisation of 
sequences, and the latter hark back to the early days of computability theory 
({45]). Filters provide an alternative to nets, but will not be discussed here for 
reasons discussed in Remark [9] 


2.1.1 Nets, a very short introduction Nets are the generalisation of the 
concept of sequence to possibly uncountable index sets, nowadays called nets 
or Moore-Smith sequences. These were first described in and then formally 
introduced by Moore and Smith in and by Vietoris in [51]. These authors also 
established the generalisation to nets of various basic theorems due to Bolzano- 
Weierstrass, Dini, and Arzela ([26] §8-9] and [5I] §4]). 


One well-know application is the formulation of fundamental topological no- 
tions like compactness in terms of nets, as pioneered in [4], while Kelley’s text- 
book is standard. Tukey’s monograph builds a similar framework, based 
on very specific nets, called phalanzes, where the index sets consist of finite 
subsets ordered by inclusion. We now list some basic definitions. 


Definition 6 A set D Æ @ with a binary relation ‘=’ is directed if 
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a. < is transitive, i.e. (Yx, y,z E€ D)([u Sy ^y xz] >z X< 2), 
b. for x,y € D, there is z € D such that xX zAy <z, 
c. < is reflexive, i.e. (Yx € D)(a < x). 


For a directed set (D, <) and a topological space X, any mapping z : D > X 
is a net in X. We denote Ad.x(d) as ‘(xa)aeD’ or ‘tq : D > X’ to suggest 
the connection to sequences. The directed set (D, <) is not always explicitly 
mentioned together with a net rq: D > X. 


The following definitions readily generalise from the sequence notion. 


Definition 7 [Convergence of nets] If za : D —> X is a net, we say that it 
converges to the limit limg £a = y € X if for every neighbourhood U of y, there 
is do € D such that for all e > do, £e E€ U. 


Definition 8 [Increasing nets] A net za : D > R is increasing if a < b implies 
La SR £ for all a,b € D. 


Now, we shall mostly use nets where the index set consists of finite sets of real 
numbers ordered by inclusion, i.e. Tukey’s ‘phalanxes’ from [49]. As noted in 
Remark [I] real numbers can readily be represented via elements of Baire space 
using primitive recursive operations. Thus, such phalanxes are essentially nets 
indexed by N". The notion of ‘sub-sequence’ of course generalises to ‘sub-net’ 
(see e.g. [42]), but we do not need this (slightly technical) notion here. 


Finally, we discuss an alternative to nets and why it is not suitable here. 


Remark 9 (Nets and filters) For completeness, we discuss the intimate con- 
nection between filters and nets. Now, a topological space X is compact if and 
only if every filter base has a refinement that converges to some point of X, 
which follows by [2] Prop. 3.4]. 


Whatever the meaning of the previous italicised notions, the similarity to the 
Bolzano- Weierstrass theorem for nets is obvious, and not a coincidence: for every 
net r, there is an associated filter base B(t) such that if the erstwhile converges, 
so does the latter to the same point; one similarly associates a net t(B) to a 
given filter base B with the same convergence properties (see [2] §2]). 


Hence, filters provide an alternative to nets, but we have chosen to work with 
nets for the following reasons, where the second one is the most pressing. 


— Nets have a greater intuitive clarity compared to filters, in our opinion, due 
to the similarity between nets and sequences. 

— Nets are ‘more economical’ in terms of ontology: consider the aforementioned 
filter base B (r) associated to the net r. By [2] Prop. 2.1], the base has strictly 
higher type than the net. The same holds for r(%) versus B. 

— The notion of refinement mirrors the notion of sub-net ((2] §2]). The former 
is studied in in the context of paracompactness; the associated results 
suggest that the notion of sub-net works better in weak systems. 
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On a conceptual note, the well-known notion of ultrafilter corresponds to the 
equivalent notion of universal net ([2] §3]). On a historical note, Vietoris intro- 
duces the notion of oriented set in p. 184], which is exactly the notion of 
‘directed set’. He proceeds to prove (among others) a version of the Bolzano- 
Weierstrass theorem for nets. Vietoris also explains that these results are part 
of his dissertation, written in the period 1913-1919, i.e. during his army service 
for the Great War. 


2.1.2 Nets and convergence We obtain a first result concerning N-reduction 
and convergence theorems for nets. In particular, as promised above, we connect 
the latter to the following operation, which is central and seems to play the role 
of the Turing jump: for given Y?, define 


J(Y) = {n EN: (Af')(¥(f,n) = 0)}. 


We now have Theorem [0]where C is Cantor space ordered via the lexicographic 
ordering <jex, i.e. the notion of ‘increasing net in C’ is obvious following Defi- 
nition [8] We note that subsets of NN or R are given by characteristic functions, 
well-known from measure and probability theory and going back one hundred 
plus of years ({12]). 


Theorem 10 The following strongly N-reduce to one and other: 


— for all Y?, there is X C N such that X = J(Y), 
— a monotone net in C indexed by Baire space, has a limit. 


Proof. To show that the second item strongly N-reduces to the first one, let 
fa: D — C be an increasing net in C indexed by Baire space and consider the 
formula (3d € D)(fa Ziex o * 00...), where o° is a finite binary sequence. The 
latter formula is equivalent to a formula of the form (4g')(Y(g,n) = 0) where 
Y has the form t(Ad.fa,n) for a term t of Gédel’s T. Now use J(Y) to define 
the limit f = lima fa, as follows: f(0) is 1 if (dd € D)(fa >1ex 100...) and zero 
otherwise. One then defines f(n +1) in terms of fn in the same way. Note that 
we only used J(Y) to define f, i.e. we have a strong N-reduction. 


For the remaining case, fix some Y? and let w! be a sequence of ele- 
ments in NN. Define fy : D > C as fw := Ak.F(w,k) where F(w,k) is 1 if 
Ji < |w|)(¥ (w(i), k) = 0), and zero otherwise. Then Aw!’ . fw is a monotone net 
(phalanx) in C indexed by Baire space (modulo coding). In case lim, fu = f, 
then it is readily verified that: 


(vn?) [EY (9,2) = 0) © f(r) = 1]. (11) 


In the notation of (4), the net Aw!” fù has the form t(Y)(w) while s does not 
depend on Y, i.e. we have a strong N-reduction. 


— 


The reader is warned that not all N-reduction results are as elegant. 
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2.1.3 Nets and compactness We connect the Heine-Borel theorem and 
convergence theorems for nets via N-reduction. 


First of all, the Heine-Borel theorem, aka Cousin’s lemma, ({6\[11]) pertains 
to open-cover compactness, which we study for the unit interval. Clearly, each 
Y : [0,1] + R* yields a ‘canonical’ covering Usejo,1 B(x, Y(x)), which must have 
a finite sub-covering. This yields the principle HBU, which has the form (I). 


(VY : [0,1] + Rt)(Sa0,...,2% € [0, 1])([0, 1] C Uice B (zi, Y(x:)))- (HBU) 


The reals in HBU are hard to compute (S1-S9) in terms of W, as shown in 
[2980], as no type two functional can perform this task. Computing a Lebesgue 
number] is similarly hard as shown in [34|. Nonetheless, HBU seems stronger 
than the Lebesgue number lemma expressing that a Lebesgue number exists for 
any W : [0,1] —> R*. We believe that Theorem [I] expresses this fundamental 
difference. 


Theorem 11 


— HBU uN-reduces to: for a monotone convergent net in [0,1] indexed by Baire 
space, there is a modulu] of convergence. 

— The Lebesgue number lemma strongly uN -reduces to: a monotone net in 
[0, 1] indexed by Baire space, has a limit. 


Proof. For the first part, fix Y : [0,1] > R* and define the following where w!” 
is a finite sequence of reals: 


aada (Yg € QN [0, 1])(4 € Ui<jw,B (w(i), Y (w(i)))) 
“| B(w)/2 otherwise l 


Here, B(w) is the left-most end-point in [0,1] of the intervals of the form 
B(w(i), P (B(w(i)))) for i < k that is not covered by the union. Note that B(w) 
and a are readily defined using u?. Modulo coding of reals, Aw" .2 can be 
viewed as a monotone net (phalanx) indexed by Baire space and we must have 
lim, £w = 1. If (wk)ken is a modulus of convergence, then |£w, — 1| < + by 
definition, implying Zw, = 1. Hence, Ui<jws|B(w(i), #(w(i))) covers [0,1] N Q. 
Now adjoin to we all the points w2(i) + ¥(w2(i)) for i < |we|, to obtain a cover- 
ing of [0,1]. This ‘adjoining’ takes the form of s(W, w2) while £w takes the form 
t(W, ”)(w) for terms s,¢ of Gédel’s T, using the notation from (4). 


For the second part, replace the output 1 by 3 + a in the first case of ry, 
where N is as follows: adjoin to w all the points w(i) + W(w(i)) for i < |w], to 


5 The notion of Lebesgue number is familiar from topology (see e.g. p. 175]) and 
amounts to the following: for a metric space (X,d) and an open covering O of X, 
the real number 6 > 0 is a Lebesgue number for O if every subset Y of X with 
diam(Y) := sup, „ey d(x,y) < 6 is contained in some member of the covering. 

6 A modulus of convergence for a net xa : D —> R with lima £a = x is a sequence 
(dk) ken with (vk E N) (Yd = dn) (|£a = z| < sr). 
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obtain a covering of [0, 1]. Now use p? to find N € N such that sy is a Lebesgue 
number for the latter covering. Note that the modified net is still monotone 
as extending w can only increase the associated Lebesgue number. Clearly, any 
cluster point of the modfied net is found in (3, 1). A straightforward unbounded 
search can now recover a Lebesgue number from the cluster point of the net 
without access to W, i.e. we have a strong wN-reduction. 


In light of the first part of the previous proof, the ‘post-processing’ term s in 
seems necessary as a Turing machine cannot evaluate a third-order functional 
at a given point due to type restrictions. 


As shown in [42], the existence of a modulus of convergence as in the first 
item of the theorem requires a fragment of the Axiom of Choice (AC) beyond 
ZF. In fact, one readily shows that the former existence statement N-reduces 
(and vice versa) to the following fragment of AC: 


(V¥*) [MEY (S, n) = 0) > (AZ°*")(¥n°)(¥(Z(n), n) = 0)], 


where we exclude the trivial case (3 f+) (Yn?) (Y (f, n) = 0). 


Finally, we connect the Lebesgue number lemma and NFP as follows. 


Theorem 12 The Lebesgue number lemma strongly N -reduces to NFP for A(n) = 
Af*)(Y(f,n) =0) for any Y°. 


~ 


Proof. By Remark [I] quantifying over 2‘ or [0,1] amounts to nothing more 
than quantifying over Baire space. To see this, define b : NN — 20 as follows: 
b(f)(n) := 0 if f(n) = 0, and 1 otherwise. Also, define t(f) := Xpo Bn) as 


the real in [0,1] coded by f € N". For Y : R > R+, the following formula is 
trivial (take g = f and large n): 


(vf € NY)Gn € N)[(ag € MIBE), gx) C Bla), Yel), 


which merely expresses that for every x € [0,1], there is n € N and y € [0,1] 


such that B(x, +) C B(y,¥(y)). Applying NFP with parameter Y, we obtain 


y € Ko such that 


(Vf €N*)[(Ag € MIBE), ray) € Beg), Yla). 


Now compute an upper bound for y on 2, using the Kleene associate for the fan 
functional ([24] §8.3.2]). This upper bound yields the required Lebesgue number, 
which only depends on y!, not on Y, i.e. we have obtained a strong N-reduction. 


We conjecture that HBU does not strongly wN-reduce to the fragment of NFP 
from Theorem 
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2.2 On the uncountability of R 


We study one of the most (in)famous properties of R, namely its uncountability, 
established by Cantor in 1874 as part of his/the first set theory paper ([10]). 
The following two principles were first studied in [35)[37]. 


— NIN: there is no injection from [0,1] to N. 
— Cantor’s theorem: for a set A C [0,1] and Y : [0,1] — N injective on A, 
there is x € ([0, 1] \ A). 


A trivial manipulation of definitions shows that NIN and Cantor’s theorem are 
logicially equivalent. We however have the following theorem and associated 
Conjecture 


Theorem 13 


— The problem NIN N-reduces to the Heine-Borel theorem HBU. 
— Cantor’s theorem N-reduces to the Heine-Borel theorem HBU restricted to 
Baire class 2 functions. 


Proof. For the first part, fix Z : [0,1] + N and define t(Z)(x) := s5>7 moti- 
vated by the notation in (4). In case xo,..., £p € [0,1] is a finite sub-covering of 
Uzelo,1)B(a, t(Z)(a)), there are i,j < k with 


Indeed, in case there are no i, j < k as in (12), then the measure of Uj<z B(x, t(Z) (xi)) 
is at most ae sot < 1, contradicting the fact that Uj<,B(2;,t(Z)(x;)) cov- 

ers [0,1]. In light of (12), given the finite sequence s(Z,2o,...,2%) defined as 

zo, t(Z)(xo),---,Uk, t(Z)(£k), we can perform an unbounded search (on a Tur- 

ing machine) to find i,j < k and k € N such that t(Z)(x;) =o t(Z)(a;) and 

[|vi — xy|](K) >Q ge, where [z](m) is the approximation of z € R up to z- 
Hence, we also obtain the consequent of (4) for the case at hand. 


For the second part, fix A C [0,1] and Y : [0,1] > N such that Y is injective 
on A. Now consider the following: 


1 

AOE EA 

uy, A)(z) = tai ax 
One readily shows that t(Y, A) : R > R is Baire class 2, as it only has countably 
many points of discontinuity by definition. For a finite sub-covering £o, ..., £k E 
[0,1] of Usejo,1]B (x, t(Y, A)(x)), there must be j < k, with x; ¢ A. Indeed, as 
in the previous paragraph, the measure of Uj<,.B(ax;,t(Y, A)(x;)) is otherwise 
at most = z < 1, a contradiction. One can effectively decide whether 
t(Y, A) (xi) < 3 or t(Y, A) (zi) > $ for i < k, i.e. one readily finds a j < k with 
Tj g A. 
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In light of the previous proof, the ‘post-processing’ term s in again seems 
necessary as a Turing machine cannot evaluate a third-order functional at a 
point due to type restrictions. 


Based on the previous proof, we conjecture the following. 
Conjecture 14 The problem NIN does not N-reduce to the Heine-Borel theo- 


rem HBU restricted to Baire class 2 functions, nor to the (full) Lebesgue number 
lemma. 


2.3 Discontinuous functions 


We show that a representative equivalence from the Reverse Mathematics lit- 
erature involving (4?) gives rise to N-reductions between the members of the 
equivalence. That N-reduction applies here was surprising to us, as the exis- 
tence of a discontinuous function like 4? does not have the syntactic form (I). 


A central role is played by Grilliot’s trick, a method for (effectively) obtaining 
3? from a discontinuous function ([I4]). We discuss this trick in some detail 
in Section [2.3.1] while the connection between this trick and N-reduction is 
discussed in Section [2.3.2 


2.3.1 Grilliot’s trick In a nutshell, Grilliot’s trick is a method for effec- 
tively obtaining 3? from a discontinuous function, say on NN or R. Clearly, 3? 
is discontinuous at 11..., making the former functional a kind of ‘canonical’ 
discontinuous function. 


First of all, Grilliot’s paper pioneers the aforementioned method, nowa- 
days called Grilliot’s trick; we refer to Remark 5.3.9] for a discussion of the 
general background and history. We note that Kohlenbach formalises Grilliot’s 
trick in a weak logical system (namely his ‘base theory’ RCAQ) in §3]. 


Secondly, Kohlenbach’s rendition of Grilliot’s trick (20) §3]) is quite easy to 
understand conceptually. Indeed, assume we have a function F : R > R anda 
sequence (n)nen With limno £n = x such that limp. F(a) Æ F(x), ie. F 
is not sequentially continuous at x. Then there is a term t? of Gédel’s T of low 
complexity such that E(f) := Af!.t(F, An.an, x, f) is Kleene’s 3? as in (6). All 
technical details, including the exact definition of t, are found in §3]. 


Thirdly, Kohlenbach uses Grilliot’s trick in [20] §3] to show that e.g. the 


following sentence implies the existence of 3°: 


(de) (vg € L({0, 1)))[e(g) € [0,1] A (Vy € [0, Ig) < g{e(9)))]- 03) 


Here, e(g) is a real in [0, 1] where the Lipschitz-continuoud’ function g: [0,1] > R 
with constant 1 attains its maximum. We note that the underlined quantifiers can 


7T A function g : [0,1] > R is Lifschitz-continuous with constant 1 on [0,1] if (Yz, y € 
[0, 1])(\g(x) —g(y)| < |x — yl). Hence, to (effectively) recover the graph of g, it suffices 
to have access to the sequence (g(q¢))qeon{o,1]: 
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be brought in the forni (3Y 2) (Yat Y’, which can also be obtained by representing 
continuous functions via second-order codes. 


2.3.2 Discontinuous functions and N-reduction In this section, we dis- 
cuss the connection between Grilliot’s trick from Section [2.3.]]and N-reduction. 
In particular, we show that the proof of Prop. 3.14], establishing the equiv- 
alence + (47), gives rise to N-reductions involving and (37), 


First of all, consider from Section The functional £ from yields 
a discontinuous function on R, which yields 3? in turn, following the proof of 
[20] Prop. 3.14]. If we make all steps in the latter proof explicit!§, we obtain a 
term t of Gödel’s T of low complexity such that 


(Ve) [(V9) A(g, (9) > (VF) BH), f)], (14) 


where A(g,x) expresses that x € [0,1] is a real where the Lipschitz-continuous 
function g : [0,1] — R with Lipschitz constant 1 attains its maximum; the 
formula (Vf!) B(3?, f) is (6), i.e. the specification of 3?. Clearly, (14) implies by 
contraposition that: 


(Ve, f*)[“B(t(e), f) + (Ag)-A(9, e(9))], (15) 


which is ‘almost’ the definition of N-reduction as in (4). Indeed, ‘(Ag)’ in 
is essentially a quantifier over R by Footnote [Z] whence (Ve) can be viewed as 
a quantifier (VZ*). Furthermore, a detailed inspection of the proof that (T3) 
implies the existence of 3? in [20] Prop. 3.14], reveals the following: this proof 
still goes through if we restrict to a sentence of the form: 


(Je)(Vn°))[e(gn) € [0,1] A (Yg € [0,1] N Q)(Gn(a) < Gn(E(Gn)))], (16) 


for some effectivd)] sequence of functions (gn)nen all in L([0,1]). In case the 
formula in square brackets in is false for some n € N, an unbounded search 
will yield this number. Hence, we can replace ‘(4g)7A(g, <(g)’ in (15) by 


{eH | a Afe}E), e({e}))) 


for some index e € N and term s of Gédel’s T, which is exactly (4). The details 
are somewhat tedious, but we nonetheless can say that the negation of 
N-reduces to the negation of (4?). 


Finally, the usual ‘interval-halving’ proof of the existence of a maximum of a 
continuous function on [0,1], can be done using 3°, yielding a term t of Gédel’s 
T such that: 


(VE*)|(Vf')B(E, f) > (Vg) A(g, (E)(9))]. (17) 


8 The construction of a discontinuous function on R in the proof of [20] Prop. 3.14] 
depends on whether e(go) € [0,4] or e(go) € [5,1], where go is the constant 0 
function and £ as in (13). This non-effective case distinction can be replaced by an 
effective case distinction whether <(go) < 2 or e(go) > 4. The proof in the first case 
goes through unmodified, while one replaces yx in the second case by —yz. 

? The join of the sequences (qx — @qeonto,1) and (—qx)geenjo,1] suffices. 
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The contraposition of then has the same form as (15). One readily obtains 
an index e € N and term s of Gédel’s T with 


(VE, 9)[A(g, ENO) > ep ES LA-B(E, {eh )], (18) 


as one only needs to decide g(r) > g(q) for r,q € [0,1] OQ to find a maximum 
of a (Lipschitz) continuous function g : [0,1] — R. Hence, an unbounded search 
on a Turing machine will find f! with ~B(E, f). We note that is a case of 
N-reduction of the negation of (3?) to the negation of (3). 


In conclusion, we observe that the negation of (4?) will N-reduce to the 
negation of (13), and vice versa. Thus, it perhaps makes sense to drop the 
‘negation of’ here and distinguish between (I) and its negation in the definition 
of N-reduction. 
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